Projected display to enhance computer device use

ABSTRACT

Methods, apparatuses and systems to receive, via at least one sensor device, data related to an area around the at least one sensor device. A target area around the sensor device to project an interactive display space via a projector is determined based, at least in part, on the data received from the at least one sensor device. The target area will include a projected interactive display space wherein interactions and objects within the projected interactive display space are to be processed via a computing device operatively coupled to the at least one sensor device.

FIELD

Embodiments of the present invention generally pertain to devices andmethods to provide enhanced computer device interaction and morespecifically to projection-based smart spaces, mobile device projectionsystems, tabletop systems, and processing physical interaction.

BACKGROUND

Use of computer systems via standard input/output devices—i.e., thescreen, mouse, and keyboard, can restrict a user's interaction with thecomputer system. Prior art methods for enhancing user interactions withcomputer have limitations that prevent convenient and enriching userexperiences.

A fixed projector has been utilized to project graphical elements in thespace around a desktop computer, but the fixed projector requirescalibration in order to adjust the image dimensions and skew.

Other systems project graphical elements and enhance input/outputcapabilities via additional hardware (e.g., cursors/icons projected onto a tablet monitor or a touch-display tabletop), but these systemsrequire additional and specific devices/hardware for the user to provideinput and output to a desktop or fixed computer system.

None of the above solutions provide enhanced user interaction for amobile computer system, wherein the mechanisms to enhance interactionare self-contained in the mobile computing system.

BRIEF DESCRIPTION OF THE DRAWINGS

The following description includes discussion of figures havingillustrations given by way of example of implementations of embodimentsof the invention. The drawings should be understood by way of example,and not by way of limitation. As used herein, references to one or more“embodiments” are to be understood as describing a particular feature,structure, or characteristic included in at least one implementation ofthe invention. Thus, phrases such as “in one embodiment” or “in analternate embodiment” appearing herein describe various embodiments andimplementations of the invention, and do not necessarily all refer tothe same embodiment. However, they are also not necessarily mutuallyexclusive.

FIG. 1 is a flow diagram of an embodiment of a process for generatingand displaying an interactive smart space.

FIG. 2 illustrates a system or apparatus projecting two smart spaces onopposing sides of a mobile computing device.

FIG. 3 illustrates how a smart space may include the ability torecognize physical objects in the immediate vicinity of a laptop.

FIG. 4 illustrates an object placed in a smart space triggering anappropriate ambient response.

FIG. 5 illustrates augmenting cross-device interaction via a projectedsmart space.

FIG. 6 illustrates object information capture within a projected smartspace for use in a computing device.

FIG. 7 illustrates multiple projected smart spaces, each of which mayhave different interactive capabilities.

Descriptions of certain details and implementations follow, including adescription of the figures, which may depict some or all of theembodiments described below, as well as discussing other potentialembodiments or implementations of the inventive concepts presentedherein. An overview of embodiments of the invention is provided below,followed by a more detailed description with reference to the drawings.

DETAILED DESCRIPTION

Embodiments of the present invention describe a self-contained,portable/mobile computing system able to dynamically establish andproject an interactive display space. Embodiments of the presentinvention may be represented as a process to determine how and where toproject an interactive display space and to execute further operationsbased on interactions captured within said interactive display space.

A projected interactive display space, or “smart space,” as referred toherein, describes a projected space peripheral to a mobile computer. Asmart space extends user interaction with said mobile computer. Thus,embodiments of the invention are directed towards augmenting userinteraction of a portable computer via a dynamically established area(e.g., on a desk, table, or other relatively flat surface). Saidaugmented interaction may be enabled by processing related to user handgesture recognition, object recognition, and object manipulationrecognition within the smart space(s).

Embodiments of the invention combine the utility of a laptop's screen,keyboard, and computing power with the natural input, extended space,and object-awareness of projected and perceived peripheral displays. Anystable surface within the periphery of a mobile computer, e.g. atabletop, may be used to project the smart space. Surfaces such astabletops lack the high input bandwidth afforded by a keyboard andmouse, while mobile computers lack surfaces for sketching, gesture,peripheral display, and sensing physical objects; however, togetherthese devices can augment each other in useful ways and ameliorate eachother's weaknesses. In one embodiment, micro-projectors are integratedwith standard laptop components to provide a large interaction spacewithout significantly increasing the laptop's size and weight, as withprior art multi-display laptops.

Embodiments of said smart spaces may detect activity within the laptopperiphery. Logic may further determine the appropriate response to saidactivity. The term “logic” used herein may be used to describe softwaremodules, hardware modules, special-purpose hardware (e.g., applicationspecific hardware, application specific integrated circuits (ASICs),digital signal processors (DSPs)), embedded controllers, hardwiredcircuitry, etc.

In one embodiment, a computer device augmented by a smart space containsall the necessary logic to execute the processing disclosed herein. Inanother embodiment, a computer device may communicate with a backendserver and/or database to process user and object interaction within asmart space.

Smart spaces may further enable the interaction between physical anddigital objects via computer vision, provide a horizontal interactivesurface along with the laptop's vertical screen, allow direct pointing,sketching, and gestures, and extend the input/output space to enrichexisting applications.

Embodiments of the invention may recognize when users perform explicitinteractions with objects within a smart space (e.g., placing a documentwithin a projected area in order to scan it) and implicit interactionswith objects to determine information about the user's current state(e.g., recognizing the user's eyeglasses on the table to determine thatthe user is not wearing them, and therefore adjusting the display of alaptop to account for the user's impaired vision).

Embodiments use computer vision techniques to recognize objects in theprojection space and to track hands and hand gestures on the table.These techniques may be implemented using the Intel® OpenCV computervision libraries and Python™ 2.5.

Variations in lighting and surface material affect both the recognitionand projection systems. Embodiments of the invention may mitigate theseverity of these variations using a combination of the followingapproaches. The system attempts to adapt automatically to changingconditions, e.g., through adaptive background subtraction. In oneembodiment, the camera input is used to perform adaptation. In anotherembodiment, the projected area may be adapted based on dedicated sensorsfor detecting the surface material or could even adapt based onlocation. In another embodiment, the system may implement lightweight,user-driven calibration steps (e.g., hand-color training). In anotherembodiment, the system may utilize a suitable choice of graphical andtextual elements and color schemes to make the projection area visibleeven under difficult lighting conditions.

FIG. 1 is a flow diagram of an embodiment of a process for generatingand displaying an interactive smart space. Flow diagrams as illustratedherein provide examples of sequences of various process actions.Although shown in a particular sequence or order, unless otherwisespecified, the order of the actions can be modified. Thus, theillustrated implementations should be understood only as examples, andthe illustrated processes can be performed in a different order, andsome actions may be performed in parallel. Additionally, one or moreactions can be omitted in various embodiments of the invention; thus,not all actions are required in every implementation. Other processflows are possible. Elements of the flow diagram below may be executedvia a processor or other appropriate hardware devices (e.g., a processormay cause a projector to project a smart space).

Process 100 illustrates that data related to an area around at least onesensor device may be received, 110. The at least one sensor may includean optical lens and a microphone and an accelerometer, and thus the datamay include an image of the area around the sensor, or audio datacaptured nearby or patterns of tapping vibration on the surface.

A target area around the sensor device to project a smart space via aprojector is determined based, at least in part, on the data receivedfrom the at least one sensor device, 120. For example, sensor data maycomprise an image of an area including a table top and a wall, and atarget area may be determined to be a space on either the table top orwall. Furthermore, audio data may indicate whether the sensor is near asuitable projected area, and may further determine an optimal targetarea (e.g., audio data captures noise from a crowd of people, and it isdetermined that, to limit visibility of a smart space, a target area onthe table top is better than a target area on a wall). Optimal size ofthe target area may also be determined by sensor data (e.g., availablespace on the table top).

If a single smart space or multiple smart spaces without restrictions onuse is to be projected, 125, then the smart space may be projected ontothe target area around the sensor, 130. If more than one smart space isto be projected and to be used by more than one user, wherein the secondsmart space is restricted with respect to the first smart space (e.g.,activity to be processed within the second smart space is restrictedwith respect to the first smart space, projected content of the secondsmart space is restricted with respect to the first smart space), 125,then a second target area to project a second smart space with respectto the restricted user is determined, 132. The first smart space maythen be projected onto the first target area around the computing deviceand the second smart space onto the second target area around thecomputing device, 134.

Interactions within any projected smart space are to be processed via acomputing device operatively coupled to the at least one sensor device,140. In one embodiment, the sensor and the projector are operativelycoupled via a network to the computing device. In another embodiment,the sensor and the projector are included in the computing device andoperatively coupled via a system bus. The smart space may be projectedin tandem with the display of the computing device. The processing ofinteractions within the projected smart space may include general handgesture recognition processing, object recognition processing,recognizing manipulations being performed on the object, and recognizinghand gestures being performed in relation to particular projectedgraphical interface components. Projecting the smart space onto thetarget area around the sensor may include processing to determinesurface properties of the target area and calibrating the projection ofthe smart space based on the surface properties of the target area.

Activity data of a user of the computing device may be retrieved, 150.This may include user history data, an appointment calendar, currentlocation coordinates, or stored data related to user tasks. Anenvironmental context of the execution of the application may bedetermined based, at least in part, on the user activity data and thedata captured via the one or more sensors, 160. Said context may includeat least one of an identity of an environment of the user of thecomputing device, an identity of the user activity. In one embodiment,the one or more sensors may include a Global Positioning System (GPS)device, and the environmental context of the execution of theapplication may be further based on the data from the GPS device. Inanother embodiment, cell phone tower triangulation or wi-fi basedtriangulation is used to determine location.

In one embodiment, the time when the data capture occurred isdetermined, wherein the determination of the environmental context ofthe execution of the application is further based on the time when thedata capture occurred. The execution of the application may be alteredbased, at least in part, on the environmental context of the executionof the application, 170. For example, if the environment is determinedto be a public place, an application outputting audio data may be muted.

FIG. 2 illustrates a system or apparatus projecting two smart spaces onopposing sides of a mobile computing device. In one embodiment, asillustrated in FIG. 2, laptop 200 (and components of laptop 200, such asa CPU, I/O devices, system memory, additional processing modules) isoperatively coupled to micro-projectors 210 and 220, positioned onopposing sides of laptop 200. Projectors 210 and 220 may be used toproject smart spaces 215 and 225 respectively.

Projectors using laser-scanning technology rather than a lens may beused to project the smart spaces, as these types of projectors mayprovide a relatively bright image that is always in focus under varyinglighting conditions.

Laptop 200 is further operatively coupled to cameras 230 and 240, eachcapable of observing user actions and objects in the projected smartspaces. The cameras and projectors may be connected to the computer viaa combination of a small, powered USB hub and the laptop's VGA input oran EVGA UV Plus USB external graphics adapter. In another embodiment,the cameras and projectors may be included in the laptop (e.g., on thesides and back of laptop display 205). In another embodiment, the inputoptics may be incorporated into the laser optics using a single chipMEMs solution.

A projection-calibration step may be executed to correct initialdistortions in the projected smart spaces. The projection area of smartspaces 215 and 225 may be affected by the height of laptop display 205.In another embodiment, where projectors 210 and 220 are physicallyembedded in the screen's frame, the volume that the projectioncomponents may occupy is restricted and thus preventing, for example,the use of multiple reflections. Automatic projector calibration usingcamera-based computer vision may be executed via methods known in theart. Subsequent processing may correct projection distortion bycomputing the homography between the distorted projection, the cameraimage, and the table surface using techniques known in the art. Thus,projected images in smart spaces 215 and 225 may be pre-distorted sothat it appears correct to the user. In one embodiment, the userconfigures the system by clicking on the four corners of one of theprojection areas in view of the respective camera, and then clicking onthe four corners of a piece of paper with known dimensions placed on thetable. This configuration is stored between uses, but may need to berepeated if laptop screen 205 is tilted significantly from its position.

User action and objects in projected smart spaces 215 and 225 may beobserved by cameras 230 and 240 respectively, and subsequently processedby laptop 200. Users can interact with projected surfaces 215 and 225using their hands. Embodiments of the invention may employ a color-basedskin detection algorithm. In each frame, processing may determine acolor histogram for each foreground object (other methods for detectingfingers are also possible, e.g., template matching or hand shapematching). An image of the user's hand at startup may be captured toaccount for skin color variations between users and in differentlighting conditions. This image may be used throughout the session.

Once the user's hand is identified, geometric features may be determinedto identify individual fingers. Known methods in the art may be used tocalculate both the convex hull and convexity defects in the hand image.Fingers are identified as points on the convex hull that are separatedby defects. A cursor position may be determined for the projectedsurface based on the user's hand shape: if a single finger is extended,that point is used as a cursor. Otherwise, the cursor is calculated asthe midpoint of the extended fingers, allowing users to interact withdisplay objects using multiple fingers.

Embodiments of the invention may support the following manual inputmethods for interacting with the projected surface: tapping, dragging,flicking, and crossing.

Tapping:

Recognizing touch-based events typically requires some method fordetecting when the user's hand contacts the surface. Infrared orshadow-based tracking systems may not be ideal if cameras 230 and 240are placed low with respect to projected smart spaces 215 and 225. Tapsof a user's fingers may be detected by an on-board accelerometer oflaptop 200. Readings from said accelerometer may be monitored, and afinger tap may be registered when the reading is greater than athreshold, determined automatically at startup based on current levels.This accelerometer-based tap detection is not falsely activated by loudsounds. To prevent other actions, such as the user typing, fromgenerating these events, a tap event may be recognized only when both anaccelerometer event is detected and when the user's finger is near atarget in the camera view (e.g., within projected smart spaces 215 and225).

Dragging:

Gesture recognition may allow users to drag items across projected smartspaces 215 and 225. Because an accelerometer cannot detect passivecontact with the surface, a user gesture may be required to drag items.The dragging gesture begins by tapping the surface, followed by draggingtwo or more fingers across the surface. This gesture causes draggableprojected objects to follow the user's hand. A drag may end when theuser closes his hand or reverts to pointing with a single finger. Adragging action by a user may also be used to detect and processsketching/handwriting by the user within the smart space.

Flicking:

Users can perform a flicking gesture by rapidly moving their fingeracross the surface in some direction. Said accelerometer may be used todetect the start of a flick, and cameras 230 and 240 may be used totrack the direction. To maximize detection accuracy, flicking motiondetection may be limited to the cardinal directions.

Crossing:

Embodiments of the invention may support interacting with on-screentargets through goal crossing. Crossing is detected by tracking theuser's finger as it travels across the surface and through interactiveelement edge boundaries projected in either of projected smart spaces215 and 225. Crossing provides an alternative selection method whentapping cannot be easily detected, such as on an unstable surface.

The addition of interactive displays 215 and 225 to laptop 200 providesnew display opportunities merely by expanding displayable space.Additionally, having projection areas 215 and 225 on either side of thekeyboard allows users to perform secondary interactions on the tabletopwhile their dominant hand is using the keyboard or touchpad of laptop200.

The availability of projected areas to either side of the keyboardallows for providing peripheral awareness and maintaining awareness ofother people or for keeping track of location-relevant information whenthe user's primary focus is on the laptop screen.

Embodiments of the projected smart space may provide a notificationscreen (i.e., a dashboard) where peripheral information can bedisplayed. The dashboard may appear when the user has not actively usedthe projected display for several minutes, and it can also be summonedmanually. This dashboard can be used to project contextual information,such as status changes posted by contacts on social networking sites.Since the quality of projected text is low, processing may favorgraphical information, and direct text-rich information to the computerscreen. Tapping on a contact's icon may open the corresponding page onthe laptop's screen. Embodiments of the invention could also useknowledge of its location to deliver location-specific peripheralawareness, such as real-time flight departure information.

Said dashboard may further include a graphical element that uses theprojection space to display thumbnails of frequently viewed webpages.Embodiments of the invention may detect when the web browser window isactive, and automatically displays the list of thumbnails. The user canthen tap on a thumbnail to load the specified webpage in the browser.

Embodiments of the invention may augment entertainment activities suchas gaming. While many current laptop computers provide fast processorsand powerful graphics cards, they are still limited by the size of thelaptop screen. Embodiments of projected smart spaces allow a richergaming experience by providing a greater display space. MassivelyMultiplayer Online Role-playing Games (MMORPGs) are prime candidates forusing this feature, as they typically provide a lot of information onthe screen. For example, a computer game may be displayed with thelaptop screen used for 3D game navigation and player-to-playercommunication, and projected displays 215 and 225 would show relatedgame map views and supplementary game information. This setup allows theplayer to focus on primary game tasks on a laptop screen while remainingaware of overall game state from peripheral projected information.

FIG. 3 illustrates how a smart space may have the ability to recognizephysical objects in the immediate vicinity of the laptop. For example, auser may be interested in tracking their use or consumption of everydayobjects, whether for financial, fitness, environmental, or otherpurposes. Rather than requiring users to log every use of a specificitem, embodiments of the invention can detect the presence of an objectin its working area, and can track and report use of that object overtime.

For example, a person who is concerned that they are spending too muchmoney at a café might use embodiments of the invention to track theircoffee consumption. As illustrated in FIG. 3, when the user placescoffee cup 310 within projected smart space 320 (projected via embeddedprojector 301), cup 310 is automatically recognized (via embedded camera302). Based on this recognition, an application executing on mobilecomputer 300 may receive a command to project chart 330, which graphsrecent coffee purchases, on smart space 320 next to cup 310, allowingthe user to see her coffee expenditure at a glance. Tapping chart 330opens a more detailed chart on computer display 305. This feature couldalso be used to share information about an object with anotherapplication.

To identify objects on the tabletop, camera 302 may capture an image ofthe projected smart space and subsequent processing may execute abackground subtraction on said camera image. In one embodiment, amixture of Gaussians is used to model the background. During start-up,camera 302 captures its current view and classifies it as background.Regions that differ from the reference background image are classifiedas foreground objects. The mixture of Gaussians method may be used indifferent lighting conditions without any special configuration, andadapts to gradual lighting changes over time, such as the changing lightfrom a window.

An adaptive method to determine whether an object remains in theforeground may be executed by computer 300 to handle cases where theuser places items on a surface without intending them to be processed bythe vision system. Each time a new object appears in the foreground,processing may be executed in an attempt to recognize it. If the objectis not recognized, the object may be incorporated into the background.This allows the user to place an item on the table, such as a book ornewspaper, without occluding future interactions in the projectionspace. A list of these unrecognized objects may be retained in case theuser later wishes to use them, e.g., to import as a figure in a paper,or to serve as a visual-search query.

A simple object recognition algorithm based on color histogram matchingmay be used to detect cup 310. First, the background is subtracted fromthe captured frame as described earlier. The connected components withinthe image may be determined and an RGB histogram for each foregroundobject may be computed. Processing then attempts to match each componentto a known object through correlation of the histograms. This method issufficient for disambiguating small sets of known objects where colorsdiffer, but would not be adequate for recognizing a wide array ofobjects (this would require, for example, a feature-based objectrecognition method). Such an object-recognition component may bedescribed as an open-world model. An open-world model allows objects tobe classified as “unknown”, while a closed-world model will alwaysclassify an object as one of a set of known objects. If an object isclassified as “unknown”, its presence may be recorded but its pixelswould be incorporated into the background.

FIG. 4 illustrates an object placed in a smart space triggering anappropriate ambient response. Embodiments of the invention may useinformation about the objects around the user to enable subtleinteractions. An object being added or removed from projected smartspace 410 (projected via embedded projector 401) may cause an adjustmentto the settings of applications executed on laptop 400, or to thesettings of projected space 410. For example, a user may take offeyeglasses 440 and place them within projected smart space 410.Subsequent processing would recognize eyeglasses 440 and increase thefont size on display 405 to allow the user to keep working. This abilityto infer the state of the user through objects around the laptop can beeasily used to create seamless interaction.

FIG. 5 illustrates augmenting cross-device interaction via a projectedsmart space. Related processing may provide the ability to recognizeobjects and share information between devices in a natural and immediateway. For example, mobile phone 550 may be placed next to projected area520 (projected via embedded projector 501) and detected by embeddedcamera 502 (or by BlueTooth protocols). Using a system to pair phone 550with the laptop 500 would enable transferring photos 551 and 552 (orother information) between the devices. As illustrated in FIG. 5, a usermay gesture (e.g., flick) photos 551 and 552 to transfer the photos toan application running on laptop 500 (e.g., photos may be copied anddisplayed as 511 and 512).

FIG. 6 illustrates object information capture within a projected smartspace for use in a computing device. Embodiments of the invention may beused to observe both computer activity and objects in the proximity ofthe computer. This ability can be used to provide links between computertasks and the physical objects that they require. A list of applicationsthat are open on the laptop may be maintained, and this list may beassociated with objects detected on the table.

Embodiments of the invention may further allow a user to capture andimport image 650 within projected smart space 610. This capability isuseful for submitting visual-search queries, for personal logging, orwhen writing a document. Camera 602 locates image 650 in the foreground,and uses its calibration information to automatically de-skew the image.Computer 600 may then execute a system-wide application (e.g.,AppleScript) to insert 650 image into the active program (displayed asimage 606), such as an e-mail message or word processing document. Inone embodiment, processing will switch resolution of camera 602 asambient factors dictate (image detail, lighting conditions, etc.).

FIG. 7 illustrates multiple projected smart spaces, each of which mayhave different interactive capabilities. Projected smart space 710 isoriented toward the user of computer 700, and may not be easily viewableby others. Projected smart space 720 may be oriented away from theuser—i.e., publicly projected. Smart space 720 may be restricted withrespect to smart space 710. For example, smart space 720 may onlydisplay images, and have limited user/object interaction, while smartspace 710 may allow user to access and edit data in addition todisplaying the images viewable in smart space 720.

Besides what is described herein, various modifications may be made tothe disclosed embodiments and implementations of the invention withoutdeparting from their scope. Therefore, the illustrations and examplesherein should be construed in an illustrative, and not a restrictivesense. The scope of the invention should be measured solely by referenceto the claims that follow.

Various components referred to above as processes, servers, or toolsdescribed herein may be a means for performing the functions described.Each component described herein includes software or hardware, or acombination of these. The components can be implemented as softwaremodules, hardware modules, special-purpose hardware (e.g., applicationspecific hardware, ASICs, DSPs, etc.), embedded controllers, hardwiredcircuitry, etc. Software content (e.g., data, instructions,configuration) may be provided via an article of manufacture including acomputer storage readable medium, which provides content that representsinstructions that can be executed. The content may result in a computerperforming various functions/operations described herein. A computerreadable storage medium includes any mechanism that provides (i.e.,stores and/or transmits) information in a form accessible by a computer(e.g., computing device, electronic system, etc.), such asrecordable/non-recordable media (e.g., read only memory (ROM), randomaccess memory (RAM), magnetic disk storage media, optical storage media,flash memory devices, etc.). The content may be directly executable(“object” or “executable” form), source code, or difference code(“delta” or “patch” code). A computer readable storage medium may alsoinclude a storage or database from which content can be downloaded. Acomputer readable storage medium may also include a device or producthaving content stored thereon at a time of sale or delivery. Thus,delivering a device with stored content, or offering content fordownload over a communication medium may be understood as providing anarticle of manufacture with such content described herein.

The invention claimed is:
 1. A system included in a mobile computingdevice and comprising: a sensor device to capture a first image data ofan area around the mobile computing device and a second image data of aprojected interactive display space and an object within the projectedinteractive display space and not included in the first image data,wherein some user and object interactions within the projectedinteractive display space are not to be processed via the mobilecomputing device, and interactions with the object are not to beprocessed via the mobile computing device; a projector to project theinteractive display space; and projector control logic, communicativelycoupled to the sensor device and the projector, to: analyze the firstimage data of the area around the mobile computing device to dynamicallyidentify and select a projection surface around the mobile computingdevice for projecting the interactive display space, includingeliminating one or more projection surfaces from being selected based ona context of the user; determine a target area on the dynamicallyselected projection surface around the mobile computing device, whereina size of the target area is determined based, at least in part, on thefirst image data of the area around the mobile computing device; sendcontrol data to the projector to project the interactive display spaceonto the target area on the dynamically selected projection surfacearound the mobile computing device, wherein the interactive displayspace is to be projected in tandem with a display of the mobilecomputing device and is to include content different and related to acontent of the display of the mobile computing device; analyze thesecond image data of the projected interactive display space and theobject not included in the first image data to determine surfaceproperties of the target area of the dynamically selected projectionsurface and properties of the object; and send control data to theprojector to calibrate the projection of the interactive display spacefor projecting onto the target area and the object based on the surfaceproperties of the target area of the dynamically selected projectionsurface and properties of the object not included in the first imagedata.
 2. The system of claim 1, further comprising: interactionprocessing logic to process interactions in the projected interactivedisplay space.
 3. The system of claim 2, wherein processing of theinteractions within the projected interactive display space comprises atleast one of hand gesture recognition processing, object recognitionprocessing, or processing to recognize manipulations being performed onan object.
 4. The system of claim 3, wherein hand gesture recognitionprocessing includes hand gestures being performed in relation toparticular projected graphical interface components of the interactivedisplay space.
 5. The system of claim 2, the sensor device to furthercapture at least one of audio or video data of an area around thesystem, and the interaction processing logic to further: retrieveactivity data of a user of the system; determine an environmentalcontext of an execution of an application utilizing the interactivedisplay space based, at least in part, on the user activity data and theaudio or video data of the area around the system, the context toinclude at least one of: an identity of an environment of the user ofthe system, and an identity of the user activity; and alter theexecution of the application based, at least in part, on theenvironmental context of the execution of the application.
 6. The systemof claim 1, wherein the target area on the dynamically selectedprojection surface around the sensor device is projected for a firstuser of the system, the projector control logic to further: determine asecond target area from the first image data to project a secondinteractive display space for a second user of the system, wherein thesecond interactive display space comprises less content than theinteractive display space; and send control data to the projector toproject the second interactive display space onto the second targetarea.
 7. The system of claim 6, wherein the second interactive displayspace is not projected in tandem with the display of the mobilecomputing device.
 8. An article of manufacture comprising acomputer-readable storage medium having instructions stored thereon tocause a processor to perform operations including: analyzing a firstimage data received from a sensor device included in a mobile computingdevice of an area around the mobile computing device to dynamicallyidentify and select a projection surface included in the first imagedata of the area around the mobile computing device for projecting aninteractive display space, including eliminating one or more projectionsurfaces from being selected based on a context of the user; determininga target area on the dynamically selected projection surface around themobile computing device to project the interactive display space via aprojector included in the mobile computing device, wherein a size of thetarget area is determined based, at least in part, on the first imagedata of the area around the mobile computing device; sending controldata to the projector to project the interactive display space onto thetarget area on the dynamically selected projection surface around themobile computing device, wherein the interactive display space is to beprojected in tandem with a display of the mobile computing device and isto include content different and related to a content of the display ofthe mobile computing device; processing some user and objectinteractions within the projected interactive display space; analyzing asecond image data received from the sensor device of the projectedinteractive display space projected on the target area of thedynamically selected projection surface and an object within the targetarea and not included in the first image data to determine surfaceproperties of the target area of the dynamically selected projectionsurface and properties of the object not included in the first imagedata, wherein interactions with the object within the projectedinteractive display space are not to be processed; and sending controldata to the projector to calibrate the projection of the interactivedisplay space for projecting onto the target area and the object basedon the surface properties of the target area of the dynamically selectedprojection surface and properties of the object not included in thefirst image data.
 9. The article of manufacture of claim 8, whereinprocessing user or object interactions within the projected interactivedisplay space includes at least one of hand gesture recognitionprocessing, object recognition processing, or processing to recognizemanipulations being performed on an object.
 10. The article ofmanufacture of claim 8, wherein the data received from the sensor deviceincludes audio data, and the processor to further perform operationsincluding: determining the context of a user of the mobile computingdevice based, at least in part, on the audio data.
 11. The article ofmanufacture of claim 8, the processor to further perform operationsincluding: receiving accelerometer data from the sensor device; anddetecting user interactions with the interactive display space from theaccelerometer data.
 12. The article of manufacture of claim 8, theprocessor to further perform operations including: sending control datato the projector to project the interactive display space in tandem witha display of the mobile computing device and to include contentdifferent and related to a content of the display of the mobilecomputing device.
 13. A method comprising: receiving, via a sensordevice included in a mobile computing device, a first image data of anarea around the mobile computing device; analyzing the first image datato dynamically identify and select a projection surface included in thefirst image data of the area around the mobile computing device forprojecting an interactive display space, including eliminating one ormore projection surfaces from being selected based on a context of theuser; determining a target area on the dynamically selected projectionsurface around the mobile computing device to project the interactivedisplay space via a projector included in the mobile computing device,wherein a size of the target area is determined based, at least in part,on the first image data of the area around the mobile computing device;projecting the interactive display space onto the target area on thedynamically selected projection surface around the mobile computingdevice, wherein some user and object interactions within the projectedinteractive display space are to be processed via the mobile computingdevice, and wherein the interactive display space is projected in tandemwith a display of the mobile computing device and includes contentdifferent and related to a content of the display of the mobilecomputing device; receiving, via the sensor device, a second image dataof the projected interactive display space projected on the target areaof the dynamically selected projection surface and an object within thetarget area and not included in the first image data, whereininteractions with the object within the projected interactive displayspace are not to be processed via the mobile computing device; analyzingthe second image data of the projected interactive display space and theobject not included in the first image data to determine surfaceproperties of the target area of the dynamically selected projectionsurface and properties of the object; and calibrating the projection ofthe interactive display space for projecting onto the target area andthe object based on the surface properties of the target area of thedynamically selected projection surface and the properties of the objectnot included in the first image data.
 14. The method of claim 13,further comprising: receiving audio data from the sensor device; anddetermining the context of a user of the mobile computing device based,at least in part, on the audio data.